Operational typicality of the nonequilibrium states: 
a thermodynamic lower bound of the deviation from equilibrium 
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The typicality of the canonical state shows that majority of the states are indistinguishable 
from equilibrium, and thus the nonequilibrium states are exceptionally rare in the extremely high- 
dimensional Hilbert space. On the contrary, we can easily apply an external force acting on the 
system, and then the actual density matrix quantitatively deviates from the canonical state specified 
by the system Hamiltonian at each instance. To express how the external forcing amounts to the 
deviation from equilibrium, we give a universal thermodynamic expression of the lower bound of 
Hilbert-Schmidt distance between the actual nonequilibrium and corresponding canonical states. 
The lower bound is expressed only by the amount of forcing and its consequent entropy production 
rate. 
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There are two apparent contradicting statements on 
the non- typicality of the states out of equilibrium. First, 
for macroscopic quantum systems consisting of a system 
of interest S and a large reservoir R, the system state p s 
is typically indistinguishable from canonical equilibrium 
state p e n in the Hilbert space from informational point 
of view[l], 0|. This canonical typicality means that the 
nonequilibrium states are considered as extremely rare 
compared with the equilibrium states. On the contrary, 
we can easily apply various external forcing to the system 
S such as manipulation of latex by optical tweezers, fine 
tuning of gate voltage in quantum dots, and any other 
thermodynamic operations. And the system state is then 
driven out of equilibrium. Therefore in this operational 
way, we can systematically prepare nonequilibrium states 
with a considerable deviation from equilibrium. It is thus 
questionable to regard the nonequilibrium states as ex- 
ceptional. 

As a first step to rationalize the paradox that the 
nonequilibrium states are rare but easily prepared, we 
need a lower bound of the deviation from equilibrium. 
This is in marked contrast to the typicality of canonical 
states [H,|i], which essentially provide upper bounds of the 
deviation from equilibrium based on the probabilistic ar- 
guments. Here it is remarked that the quantum ergodic 
theorems [1, H| discuss on the expectation values of only 
a limited class of macroscopic quantititesQ, which do 
not contain the full information of the actual state or 
the density matrix, and in these cases preparation of ini- 
tial states with considerable deviation of the quantities 
of interest is actually difficult. We emphasize that our 
quantity of interest is the density matrix itself. 

In this letter, we thermodynamically express the lower 
bound of this deviation p s (i) — p eq (t) between the actual 
nonequilibrium state of the system p s (t) and the equilib- 
rium p eq (t) specified by the instantaneous system Hamil- 



tonian H s (t) with the use of a strength of the external 
forcing and its consequent entropy production. 



We consider a time evolution of an externally forced 
system which weakly interacts with a large reservoir Q. 
The evolution of the total system(system and reservoir) 
is unitary. We externally manipulate the system during 
the initial and the final time < t < T. The reservoir is 
assumed to be large enough so that its thermodynamic 
properties such as temperature are regarded as constant 
during our operation. The total Hamiltonian 



H(t)=H s {t)+H r + V 



(1) 



is the sum of those of the system H s (t), the reservoir 
H r , and the interaction between them V, respectively. 
Initially, the system and the reservoir are in an equi- 
librium at an inverse temperature (3 = y^t- Here fcs 
is the Boltzmann constant, and T is the absolute tem- 
perature. The system Hamiltonian H s (t) is time de- 
pendent due to the external forcing during < t < T. 
Then the system state becomes out of equilibrium. From 
microscopic point of view, the initial total density ma- 
trix p(0) evolves as U(t)p(0)U(t) + by a unitary operator 
U(t) = T{e~%f° H ( s ) ds ^ which is given as a solution of 
the Schrodinger equation iU dU Jp = H(t)U(i) with the 
initial condition U(0) = 1. And we shall evaluate how 
the actual reduced density matrix 



p s (t)=Tv r U(t)p(0)U(t) + 

deviates from the instantaneous canonical state 

1 



Peq(t) = 



Z s {t) 



-f}H s (t) 



(2) 



(3) 



'Electronic address: monnai@suou.waseda.jp 



which is specified by the system Hamiltonian H s (t) 
and the inverse temperature of the reservoir ft. Here 
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the partition function is defined from the normalization 
Z s (t) = TT s e~^ Hs ^K In order to evaluate the devia- 



tion from equilibrium, we first note that the dissipative 
work Wdiss measures how far the system is deviating 
from equilibrium@, H| which is well-defined even far out 
of equilibrium 0, H[. The dissipative work 



W dlss = W - AF 



(4) 



is the extra work required to achieve the nonequilib- 
rium process aside from the minimum work given by 
the free energy change AF for the adiabatically slow re- 
versible process. Here the free energy change is defined 
from the partition functions of the system at initial and 
final times as AF = ~jj log ^ s |*j . The work is defined 
as the energy change due to the time dependence of the 
Hamiltonian [ljJIIII 



W 



T 



dm s {p s (t)H s (t)}, 



(5) 



where the reservoir variables are traced out, and the re- 
duced density matrix p s (t) = Tr r U(t)pU(t) + in the 
Hilbert space of the system states H s gives the ac- 
tual state, which deviates from the equilibrium state 
p eq {t) — z\t) e ~^ H ^ e don't need the explicit ex- 
pression of the heat, however, we show the definition for 
completeness. From the first law of thermodynamics, the 
heat flowing to the system is automatically determined 
as the energy variation due to the change of the state [Toj 
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Q= / dtTr{-[H(t),U(t)p(0)U + (t)}H s (t)}. (6) 
Jo lh 

Indeed, by taking the time derivative of the expectation 
value of the system Hamiltonian, the total energy change 

Tr ([U(T)p{G)U + {T)H s {T)} - p(0)H s (0)) 
= W + Q (7) 

is composed of the work done and the heat flowing to 
the system. We also note that the work done along the 
instantaneous canonical state given in Eq.Q is equal to 
the free energy change 



r 



1 



T 

„ dms Jt\jz7tf 



d ( ~! „-0H s {t) 



T 



AF. 



(8) 



The first equality is from the integration by parts. 
In the second equality, we used the normalization 



Tr 



1 for all t in the first and the sec- 



ond terms. The dissipative work is then calculated with 
the use of Eqs. ([5T 



W dlS8 

W - AF 

r 

dtTt s {(p s (t) - p eq (t)) 6,(t)} 

> 0. (9) 

The positivity is from the second law of thermodynam- 
ics. The dissipative work expresses the entropy produc- 
tion in a nonequilibrium process of an isothermal system. 
This equation ([IJJ is well-known as the minimum work 
principle in thermodynamics [12], however, it is remark- 
able that the distance p s (t) — Peqif) between the actual 
and equilibrium states explicitly appears. 

Then our first result is directly obtained from Eq.©. 
Let us apply the Cauchy-Schwartz inequality (l3j to the 
integrand as 

Tr s {(p s (t) - p eq (t)) fi s (t)} 
< (Tr s (p s (t) - p eq (t)) 2 y (Tr s A s (t) 2 ) 3 , (10) 

which disentangles the deviation from equilibrium p s (t) — 

Peq(t) and the external forcing H s (t). Then from 
Eqs. (|9ll0j) . we have a mo del- independent lower bound 
of the Hilbert- Schmidt distance between the actual and 
the canonical states 



(Tr s (p s (t) - p eq (t)) 



2\ 2 



> 



|w- di „(t)| 



Tr,F. 



(11) 



Here the lower-bound solely depends on the external per- 
turbation H s (t) and its consequent dissipative work done 
per unit time Wdiss{t)- This relation directly shows that 
the external forcing yields dissipative work, and simul- 
taneously the state deviates from the equilibrium. Es- 
pecially, in the perturbation regime of weak forcing, we 
have the linearity of — [ij^aiMI ^ averaged over a short 

(Tr s H s (t) 2 ) 2 

l 

time with respect to the forcing (Tr s H s {t) 2 ^ 2 as shown 

in Fig. 2. Then, the right hand side of Eq. ([TT1) is propor- 

i 

tional to the external forcing (Tr s H s (t) 2 ^ 2 at the low- 
est order, which explicitly shows that more stronger the 
forcing is, the more the actual state deviates from equi- 
librium. Namely, in the linear regime the distance is 
expressed as 

(Tr s (p s (i) - Peq (t)) 2 Y cx (Ti s H s {t) 2 Y , (12) 

which shows that the deviation is of the first order with 

i 

respect to the forcing 
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In Fig.l, we have numerically demonstrated how the 

i 

distance (Ti s (p s (t) — p eq (t)) 2 )) 2 is bounded by the ther- 
modynamic quantity — [^ig»MJ ± f or a TV-site quantum 

(Tr s iJ s (t) 2 ) 3 

spin chain in a spatially inhomogeneous oscillating mag- 
netic field 14]. We consider the nearest neighbor ex- 
change coupling and on-site magnetic energies. More 
precisely, the total Hamiltonian H(t) is given as 

H(t)=H s (t) + H r + V; 

< Hr = Ef=N s+ 2 + + (13) 

V = e(-Ja z Na+1 a z Na+2 +a% 3+1 +a z Ns+1 ) , 

where an oscillating magnetic field B(j, t) — (1, 0, h(j, t)) 
is externally applied with h(j, t) — ho sin 2ant for 1 < 
j < N s and h(j,t) = ho for j > N s + 1. Namely, we 
regard the sites j = 1,...,N S as the subsystem, N s + 
2 < j < N as the reservoir, and j = iV s + 1 as the 
interaction between them. We choose the system size 
N s = 2, and the total system size N = 8. We consider the 
ferromagnetic coupling J — 1, edge of the linear regime 
fro = 1, and the weak coupling parameter is chosen as e = 
0.1[? ]. Note that the thermodynamic properties can be 
verified for the relatively small system size [13, Gil- This 
is because the 0(e N ) dimension of the Hilbert space does 
matter instead of the total system size iV itself. There 
is a numerical support of this statement based on the 
system size dependence of the many body Hamiltonians 
for 6 < N < 12H3. 

Let us investigate the time evolution. Initially, the 
system and the reservoir are in thermal equilibrium at 
an inverse temperature /3 = 1, p s {0) = z e~^ Ha ^ 

and p r — -^-e~ l3Hr . Then we have numerically solved 
the unitary evolution by using a discretized evolu- 
tion operator U(nAt) = e -iA(nAt)At e -i6(nAt)At . . . 

e -iH(At)At e -iH(0)At with a time step Af = Q 02 which 

is much shorter than the period of the oscillation. Ac- 
tually, compared with the numerical data for At = 0.05, 

the results are regarded as well- converged. Importantly, 

1 

in Fig.l, the lower bound [Tr s H s (t) 2 ^j is of the same or- 

1 

der as the distance (Tr s (p s (t) — p e q(t)) 2 ) 2 for most time 
t. This shows that we can roughly estimate the distance 
by calculating the ratio — liffjiagiiH ^ _ The frequency of 

(Tr s iJs(t) 2 ) 2 

the oscillating magnetic field is chosen as a = 0.2 for 
Fig. 1(a) and a = 1 for Fig. 1(b), respectively. We have 
confirmed that qualitatively similar plots are obtained 
for other frequencies a > 0. 

The lower bound in Eq. (fTTj) — \ w d" S (t)\ ^ avera g ec [ over 

(Tr 3 if s (t) 2 ) 3 

a short time 0.9 < t < 1.1 is shown in Fig. 2 as a function 



1 

(tr( Pl (t)-p eq (t)) 2 )J 
1.2 r 
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FIG. 1: Comparison between the distance 

(Tr s (p 3 (t) — p eq (t)) 2 ) 2 (blue line) and the thermodynamic 
lower bound ^ d "° — r(red dashed line). The distances 

(Tr 3 H 3 (t) 2 ) 2 

temporally oscillate with the same frequency as the external 
magnetic field both for (a) a = 0.2 and (b)a — 1. The 
distance is small but not zero at t = due to the finite 
coupling strength. 



of external forcing yTr s H s (t) 2 J averaged over the same 

period 0.9 < t < 1.1. We only changed the strength of 
the magnetic field ho from to 1, and fixed the frequency 
a = 0.2. Then we observe that the distance linearly 
dependends on the external forcing. 



As a measure of distance between the states, there are 
other choices such as the spectral norm. This is achieved 

by making the operators p s (t) — p eq (t) and H s (t) positive, 
and apply the Holder-inequality. The positive operator 
|A| is defined for each observable A = J2 n \ A n )A n (A n \ 
based on the spectral decomposition as 

\A\ = J2\An)\A n \(A n \, (14) 

n 
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<W diss (t)/(tr s // s (t) 2 )i> 
0.15 

0.10 
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FIG. 2: Thermodynamic lower bound { iimLl } \ s plot- 

(Tr s H s (t) 2 )2 

l 

ted as a function of the external forcing { (Tr s H s (t) 2 ^ 2 ). {) 

shows the average over a short time 0.9 < t < 1.1. The red 
line shows a numerical fitting. 



where \A n \ is the absolute value of the eigenvalue A n . For 
simplicity, we use the notation for the discrete spectrum, 
but the continuous case is also available. Then the Holder 
inequality shows for p, q > satisfying ~ + ~ = 1, 

i 

(Tr s \p s (t) - p eq (t)\ P )* (Tr s \Hs(t)\«y 

> Ti s (p s (t) - p eq (t))H s (t). (15) 

Then by taking the limit p — > oo, we have a lower bound 
for the distance measured by the spectral norm \\A\\ = 

su P\y)eH B |^f4) defined on the Hilbert space of the 



system H s as 



> 



\\p s (t) - Peq (t)\ 

\W diaa \ 
Tr a \H a (t)\' 



Eqs. (|llll6j) express the lower bound of the distance be- 
tween the actual and canonical states by the dissipativc 
work per unit time and the amount of forcing. Note that 
another choice of the parameter p and q also gives mea- 
sure of distance. These thermodynamic expressions of 
the deviation from equilibrium are our main result. 

Indeed, the presence of the lower-bound is in marked 
contrast with the typicality of the canonical state which 
essentially gives a typical upper bound, i.e. if we ran- 
domly choose a pure state I*} from the Hilbert space H s 
at an energy scale E and weak coupling is satisfied, then 
the reduced density matrix Tr r |\l/)( 1 i , | is indistinguishable 
from the canonical equilibrium state with a probability 
very close to unity [l|, 13. fl7j. 

In conclusion, we derived universal lower bounds for 
the deviation from instantaneous equilibrium state due to 
the external forcing and its consequent dissipative work 
or entropy production. It is remarkable that the lower 
bound does not explicitly depends on the model, and is 
thus regarded as thermodynamically universal. The ar- 
gument in this letter holds both for systems with finite 
and infinite dimensional Hilbert space, which is advanta- 
geous compared to the quantum ergodic theory. 
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